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ABSTRACT 

The Performance Indicators in Education program is 
designed to develop methods of measuring the performance in reading 
and arithmetic achievement at the elementary school level of the 
schools of New York State. From data on file at the State Educatiqn 
Department, a set of profiles was developed for each of 628 school 
districts indicating how the district performed in elementary school 
reading and arithmetic. This workbook provides worksheets to aid the 
100-plus districts that did not receive profiles in calculating their 
performance scores for the 1969-70 and 1970-71 school years. The 
worksheets, samples of which are provided in the appendixes, are: (1) 
four "Foundation Sheets" upon which the district's data are entered; 
(2) eight separate "Equation Worksheets" that pr.ovide a measure of 
one of the criteria — reading or arithmetic — for grade 3 or 6; and (3) 
blank "Profile o± School District Characteristics" forms upon which 
derived measures may be recorded. A list of symbols is also provided. 
Uses and limitations of the profiles are discussed in the publxcatxon 
"Performance Indicators in Education, Local District Results — 1972," 
which is available from the Bureau of School Programs Evaluation pf 
the New York State Education Department, (DB) 
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FOREWORD 

This is one in a series of evaluative aids which the Bureau of 
School Programs Evaluation has produced or is producing for the use of 
local school personnel. The Quality Measurement Project produced two 
School Quality Workbooks as well as a manual describing the use of 
nomographs in assessing school district performance. It is hoped that 
this more recent series of aids, developed in the Performance Indicators 
in Education program, follows in that tradition. The aids include: 

"Performance Indicator in Education— Local District Results— 1972," 
which was disseminated to each of 628 districts in the State along with 
a profile of variables describing certain characteristics of the district 
and its performance on reading and arithmetic in grades 3 and 6. 

"Variables Related to Student Performance and Resource Allocation 
Decisions at the School District Level" (1972), which surveyed the 
literature produced over the last 15 years concerning research into factors 
related to student performance. Since it was a somewhat detailed and 
technical report, it was disseminated to various research groups, libraries, 
chief State school officers, and similar groups. A summary of the results 
for a wider audience is described next. 

"What Research Says About Improving Student Performance" is a non- 
technical summary of the publication described inmediately above. Its 
publication date is spring, 1973. 

"Performance Indicators in Education Telephone Survey" describes 
an effort to obtain systematic feedback from school districts about the 
reception of the Performance Indicators reports and the uses to which 
results have been put at the local level. 
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Two additional publications » scheduled for release later this year, 
will describe factors under the control of school officials which are 
related to the achievement of students in reading and arithmetic. The 
studies are based on samples of districts in New York State and will 
focus on classroom processes and school district expenditures. 

This series of aids provides a multifaceted approach to school 
evaluation. It includes research done elsewhere, results of research 
done in New York State, and evaluative information related to each school 
district and its comminity. 



Lorne H. Woollatt 
Associate Commissioner 
for Research and Evaluation 
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PERFORMANCE INDICATORS WORKBOOK 

The Performance Indicators i n Education Program 

The Performance Indicators in Education program is designed to 
develop methods of measuring the performance of the schools of New York 
State. At the present time, the major effort has been directed toward 
assessing performance of school districts in reading and arithmetic 
achievement at the elementary school level. 

Data for the program were drawn from the files of the State Education 
Department. The data are routinely reported to the Department by local 
school districts through the Pupil Evaluation Program, the Basic 
Educational Data System, and related programs. 

Through the statistical process of multiple regression analysis, the 
relationships between a number of variables not controlled by the school 
district and student achievement are obtained and expressed as an 
equation. The performance of a given school district is measured by 
solving the equation using that district's data to obtain an expected 
achievement score. The difference between the expected score and actual 
district average achievement score is attributable in part to the impact 
of the school. (Part of the difference may also be the result of 
inadequate data and to error of measurement.) 

In the fall of 1972 reports were disseminated to 628 school districts 
in New York State. This comprised the majority of districts in the State. 
However, the six largest cities had been omitted because it was felt 
that district-wide results would have little meaning in such districts. 
In addition, more than 100 districts were omitted because complete data 



were not available in the State Education Department's data files at the 
time analyses were started to develop performance scores* 

The reports gave each district a set of profiles which indicated 
how the district performed in elementary school reading and arithmetic. 

The major purpose of this workbook is to give those 100-plus 
districts which did not receive a report an opportunity to calculate 
their performance scores. In addition^ s^me districts — among the 
original 628 or among the additional 100— 'may wish to see how changing 
conditions in their conmrunities or stttdent bodies might be expected to 
affect the achievement of students. This workbook could be used for 
that purpose. 

Performance Indicators Worksheets 

In order to help districts compute their performance in elementary 
school reading and arithmetic, several worksheets have been devised. 
They are designed to aid the district in determining its own performance 
for the 1969-70 and 1970-71 school years. 

1. Four Foundation Sheets are provided upon which the 
district's data are entered. Then, preliminary cal- 
culations are carried out. 

2. Eight separate Equation Worksheets follow. Each one 
provides a measure of one of the criteria— reading or 
arithmetic, for grade 3 or grade 6, for 1969-70 

or 1970-71. 

3. Blank Profile of School District Characteristics forms 
upon which derived measures may be recorded are provided. 

A list of symbols is also provided to aid in int-»rpreting the abbreviations 
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used on the foundation and equation worksheets. 



Foundation Sheets 

The four Foundation Sheets can be used to record the various kinds 
of data needed to complete the Equation Worksheets and the school 
district profiles. 

Original data for completion of the Foundation Sheets are available 
in the records of the school district. PEP scores are the averages 
(means) reported to the school district by the Bureau of Pupil Testing. 
Enrollment totals, by grade or by .->rity group, are those reported on 
the Basic Educational Data System (BEDS) forms. Expenditure figures 
correspond to those reported on the Annual Financial Report. A formula 
is provided in the "derivation" column for those variables which must 
be calculated. The value of each variable can be recorded in the right- 
hand column opposite its symbol. 

Equation Worksh3ets 

After the Foundation Sheets have been completed, the variables for 
a given Equation Worksheet may be selected and entered in their proper 
sequence in the "Value of Variable" column of the Equation Worksheet. 
Each value is then multiplied by its corresponding coefficient and the 
result entered in the "Weighted Value" column. When all necessary 
multiplications have been accomplished, the "Weighted Values" are totalled 
to find the "Total" or Expected Score. Those 'Veighted Values'^aving a 
negative value are indicated by minus signs and must be subtracted as 
the column is totalled. 

As indicated earlier, the difference between the district's expected 
score and its actual score may be due in part to error of measurement 

3 

O 

ERIC 



T 



which exists in most testing and statistical procedures. To reduce the 
possibility of concluding that a difference exists when in actuality 
the apparent difference may be due to chance fluctuations in scores, 
confidence limits are established above and below the expected score. 
This is accomplished by adding one standard error to the expected score 
to obtain the upper confidence limit and by subtracting one standard 
error from the expected score to obtain the lower confidence limit. 

If the actual score falls outside of the confidence limits, there 
is a two-thirds probability that the difference between the actual and 
expected scores is not due to chance. If the actual score is higher 
than the upper confidence limit, we may tentatively conclude that the 
district is doing well with reference to the achievement measure under 
consideration. That is, conditions under the control of school personnel 
have caused the students to achieve better than ordinarily expected, 
given the conditions under which the schools operate and the level of 
achievement of students as they entered that level of the district's 
educational program. The opposite conclusion may be drawn if the actual 
score falls below the lower confidence limit. If the actual score falls 
between the two confidence limits, the school district is doing about 
what is expected. That is, it seems to be doing an average or typical 
job with existing circumstances. 

Profile Sheets 

After the Equation Worksheets have been completed, the data are 
transferred to the Profile of School District Characteristics forms. 
Data from the Foundation Sheets are entered on the Profile Sheets, also. 
This can be done by placing an arrow in each scale indicating the value 
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of the variable on the Foundation Sheets. The variables are listed on 
the Foundation Sheets in the same order as the columns on the Profile 
Sheets with the exception of four Achievement Gain Scores which appear 
on the fourth profile sheet. These were experimental and, because they 
seemed to add little to the other information, have been eliminated for 

our purposes here. 

Confidence limits for each of the eight achievement measures are 
taken from the bottom of the appropriate Equation Worksheets and entered 
as horizontal lines across each of the designated achievement scales. 

A section of a Profile Sheet, illustrating the procedures described 
above, can be found on the next page. 

Uses and limitations of the profiles are discussed in the publication, 
"Performance Indicators in Education, Local District ResultS"1972." It 
is available from the Bureau of School Programs Evaluation of the New 
York State Education Department. It will be useful to anyone calculating 
performance measures for his school district. 
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Type of Information entered on Profile Sheets 



APPENDIX A: FOUNDATION SHEETS 



FOUNDATION SHEET 1 



Symbol * 


Derivation (where required) 


Value 


1R66 






1R67 






1R68 






lRsd66 






lRsd67 






lRsd68 






3R68 






3R69 






3R70 






3Rsd68 






3Rsd69 






3Rsd70 






3A68 






3A69 


• 




3A70 






3Asd68 






3Asd69 






3A8d70 






6R68 






6R69 






6R70 






6Rsd68 






6Rsd69 






6R8d70 







^See appendix B for definitions of symbols. 
O 8 
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FOUNDATION SHEET 2 



Symbol 


Derivation 


Value 


6A68 






6A69 






6A70 






6Asd68 






6Asd69 






6Asd70 






Enrol. 70 


Total 1-12 Enrol. 1970 




ES 69 


•69 6th Gr. Enrol. ♦ 1st Gr. Enrol. 




FTV68 


(FTV '68 f 1-12 Enrol. ^68) ♦ 1,000 




D68 


Sq. mi. i 1-12 Enrol. '68 




PR70Ppl 


3rd Gr. #N + SB students '70 i 3rd Gr. Enrol. 
•70 




PR70Stf 


#N + SS staff '70 T # Total staff '70 




Exp. Prln. 


Exp IS Prin. ♦ '68 Enrol. 1-12 




Exp. Other 


Exp IS Other 4 ^68 Enrol. 1-12 




Exp. Tch. 


Exp Tch 4 '68 Enrol. 1-12 




Exp. Inst. 


Exp Inst 4 '68 Enrol. 1-12 




ExpCAd 


Exp Cent. Ad ♦ '68 Enrol. 1-12 




Av. 1R66,67 


1R66 + 1R67 
2 




Av. lRsd66, 
67 


lRsd66 + lR8d67 
2 




Av. 3Rsd66, 
67 


3Rsd66 + 3Rsd67 
2 




Av. 1R67,68 


1R67 + 1R68 
2 
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FOUNDATION SHEET 3 



Symbol 

Av. lRsd67, 
68 

(D68)^ 

G 



S68 

3R66 

3Rsd66 

3A66 

3Asd66 

3R67 

3Rsd67 

3A67 

3Asd67 

6R66 

6A66 

6Rsd66 

6Asd66 

6R67 

6A67 

6R8d67 

6Asd67 

1st Enrol. 
69 



Derivation 



Value 



lRsd67 + lRsd68 
2 

(Sq. Mi. ♦ 1-12 Enrol. '68)^ 

(1-12 Enrol. '70) - (1-12 Enrol. '68) 
(1-12 Enrol. '70) + (1-12 Enrol. '68) 
2 

Total 1-12 Enrol. 1968 f 1,000 



1st grade enrollment 1969 
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6th Enrol. 
69 

3rd Enrol. 
N+SS70 

3rd Enrol. 
Total 70 

6th Enrol. 
Total 70 

N+SS Staff 
70 

T Staff 

Enrol. 68 

Sq. ml. 



6th grade enrollment 1969 



Total staff 1970 

Total 1-12 enrollment 1968 

Square miles in district 1971 
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DEFINITIONS OF SYMBOLS 



Symbol 
1R66 
1R67 
lRsd66 

3R68 
3Rsd69 

6A70 

Enrol. 70 
ES69 
FTV68 
Dft8 

PR70 or PR70Ppl 

PR70St 

Exp. Prln. 

Exp. Other 
Exp. Tch. 



Definition 

First grade readiness (PEP) district average for 1966 

First grade readiness (PEP) district average for 1967 

First grade readiness (PEP) district standard 
deviation for 1966 

Third grade reading (PEP) district average for 1968 

Third grade reading (PEP) district standard 
deviation for 1969 

Sixth grade arithmetic (PEP) district average for 1970 
Total grade 1-12 enrollment in 1970 
Enrollment stability* 

Full tax value or property valuation in 1968* 

Density of population expressed as square miles per 
pupil* 

Proportion of minority students* 
Proportion of minority staff* 

Per pupil expenditure for principals' salaries, 
equipment, supplies, and materials* 

Per pupil expenditure for all other supervisory staff 
which includes salaries, equipment, supplies, & 
material s* 

Per pupil expenditure for teaching includes salaries 
of teachers, substitutes, and noninstructional 
personnel along with their equipment, supplies, & 
materials* 



*See Foundation Sheets for method of calculation. 
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Exp# Inst* Per pupil expenditure for instruction for regular day 

school including salaries, equipment, supplies, and 
materials for teaching, substitute, supervisory, 
psychological, guidance, attendance, extra- 
curricular, athletic, and health personnel* 

Exp* CAd# Per pupil expenditure for centrral administration 

which includes salaries, matc^rials, equipment, 
supplies, and materials o€ chief school admini- 
strator, curriculum devel^^pmert, business, research, 
personnel, and school -coniiunity relations staff* 

Av* 1R66,67 Average of 1966 and 1967 re.-diness (PEP) school 

district mean (average) scores* 

Av. 3R8d67,68 Average of 1967 and 1968 reading (PEP) school district 

mean (average) standard deviations* 

(068)^ Density squared 

G Growth* 

3rd Enrol* N + Number of minority students in third gr-^.de in 1968 

SS 68 



See Foundation Sheets for method of calculation* 
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EQUATION WORKSHEET 1 
THIRD GRADE READING 1969 



Var. 
No. 



Variable 
Symbol 



Variable Name 



Coefficient 



Value of 
Variable 



Weighted 
Value 



S68 
FTV68 
PR70 

D68 

1R66,67 
lRsd66,67 



Size 1968 

Full Tax Value 1968 

Proportion N + SS Pupils 
1970 

Density 1968 

Aver. Rdn. 1966 & 1967 

Aver. Rdn. ^tand. Dev. 
1966 & 1967 

Constant Term 



.16000 
.03563 

—7.19713 

— .66771 

.27843 :: 

— .13104 



Total (Expected Score) 

Expected Score 
+ Standard Error 



Upper Confidence Limit 



Expected Score 
- Standard Error 



Lower Confidence Limit 



Actual Score (School dis- 
trict average third grade 
reading score for 1969) 
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EQUATION WORKSHEET 2 
THIRD GRADE READING 1970 



Var. 
No. 



Variable 
Symbol 



Variable Name 



Coefficient 



Value of 
Variable 



Weighted 



2 



S68 

FTV68 

PR70Ppl 

D68 

1R67,68 
1 Rsd67,68 



Size 1968 



Full Tax Value 1968 



Proportion N + SS Pupils 
1970 



Density 1968 



Aver.Rdn. 1967 & 1968 



Aver,Rdn« Stand. Dev. 
1967 & 1968 

Constant Term 



,13000 



.02995 



-5,22140 :: 



-1,61395 



.29849 



.11156 



Total (Expected Score) 



Expected Score 
+ Standard Error 



Upper Confidence Limit 



Expected Score 
— Standard Error 



Lower Confidence Limit 



Actual Score (School dis- 
trict average third grade 
reading score for 1970) 



EQUATION WORKSHEET 3 
THIRD GRADE ARITHMETIC 1969 



Var. 
No. 


V U A, ^ CI A C 

Symbol 


Variable Name 


Coefficient 


Value ot 
Variable 


Weighted 
Value 


X, 
^1 


S68 


Ql7P 1 OAR 


• i /uuu 






^2 


FTV68 


Full Tax Value 1968 ' 


.04946 : 


: 


s: 


^3 


PR70Ppl 


Proportion N + SS Pupils 
1970 


-11.41959 : 


: 




X4 


D68 


Density 1968 


- 3.50241 : 


: 






D682 


Density squared 


5.24508 ; 




e 


^10 


(D68) (FTV68) 


Density x Full Tax Value 


- .10619 : 


: 




h 


1R66,67 


Aver. Rdn.1966 & 1967 


.26865 : 


: 






lRsd66,67 


Aver.Rdn.Stand.Dev, 1966 
6c 1867 


- .12191 : 


t 




X 




Constant Term 






16.80 



Total (Expected Score) 
Expected Score 
+ Standard Error 



Upper Confidence Limit 



Expected Score 
— Standard Error 



Lower Confidence Limit 



Actual Score (School dis- 
trict average third grade 
arithmetic- score for 1969) 
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EQUATION WORKSHEET 4 
THIRD GRADE ARITHMETIC 1970 



Var. 
No. 



Variable 
Symbol 



Variable Name 



Coefficient 



Value of 
Variable 



Weighted 
Value 



^10 



S68 

FTV68 

PR70Ppl 

D68 

068^ 

(D68)(FTV68) 
1R67,68 
lRsd67,68 



Size 1968 

Full Tax Value 1968 

Proportion N + SS Pupils 
1970 

Density 1968 

Density Squared 

Density x Full Tax Value 

Aver.Rdn. 1967 & 1968 

Aver . Rdn . S t and . Dev . 
1967 & 1968 

Constant Term 



.16000 
.04019 
-9.78807 :i 

- 8.48126 

8.73411 

- .12295 
.29552 

- .13892 



14.94 



Total (Expected Score) 



Expected Score 
+ Standard Error 



2.88 



Upper Confidence Limit 



Expected Score 
- Standard Error 



2.88 



Lower Confidence Limit 



Actual Score (School dis- 
trict average third grade 
arithmetic Score for 1970) 
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EQUATION WORKSHEET 5 
SIXTH GRADE READING 1969 



Var. 
No. 


Variable 
Symbol 


• 

Variable Name 


Coefficient 


Value of 
V arxaDie 


Weighted 
Value 


X2 


FTV68 


Full Tax Value 1968 


.02518 


: 




^11 


3R66 


Third Grade Rdg. 1966 


.69724 ' 


: 


1 


^12 


3Rsd66 


Third Grade Rd£. Stand. 
Dev. 1966 


.30847 : 


c 


: 


X3 


PR70Ppl 


Proportion N + SS Pupils 
1970 


- 7.82524 : 


: ' 




L J 


G 


Growth 










D68 


Density 1968 


.12996 ] 


[ 1 


B 




D682 


Density Squared 


- .03689 : 


: ' 




h 


1R66,67 


Aver.Rdn. 1966 & 1967 


.08357 : 






a 




Constant Term 






10.10 



Total (Expected Score) 

Expected Score 
+ Standard Error 



Upper Confidence Limit 



Expected Score 
- Standard Error 



Lower Confidence Limit 



Actual Score (School dis- 
trict average sixth grade 
reading sc re for 1969) 



2.10 



2.10 
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EQUATION WORKSHEET 6 
SIXTH GRADE READING 1970 



Var. 
No. 



Variable 
Symbol 



Variable Name 



Coefficient 



Value of 
Variable 



Weighted 
Value 



^15 
^13 



FTV68 
3R67 
3Rsd67 

PR70Ppl 

G 

D68 
D682 

1R67,68 



Full Tax Value 1968 
Third Grade Reading 1967 

Third Grade Reading Stand. 

Dev. 1967 
Proportion N + SS Pupils 

1970 
Growth 

Density 1968 
Density Squared 
Aver. Rdn. 1967 & 1968 
Constant Term 



.02261 
.69287 

.41676 

— 8.01427 :c 

— 2.73022 

— 1.41214 

— .42889 
.11680 



6.44 



Total (Expected Score) 



Expected Score 
+ Standard Error 



1.99 



Upper Confidence Limit 



Expected Score 
- Standard Error 



1.99 



Lower Confidence Limit 



Actual Score (School dis- 
trict average sixth grade 
reading score for 1970) 
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EQUATION WORKSHEET 7 
SIXTH GRADE ARITHMETIC 1969 



Var. 
No. 



Variable 
Symbol 



Variable Name 



Coefficient 



Value of 
Variable 



Weighted 
Value 



^16 



^12 



^17 



FTV68 
3A66 

3Rsd66 
3Asd66 
PR70Ppl 

D68 

1R66,67 



Full Tax Value 1968 

Third Grade Arithmetic 1966 

Third Grade Reading Stand. 
Dev. 1966 

Third Grade Arith. Stand. 
Dev. 1966 

Proportion N + SS Pupils 
1970 

Density 1968 

Aver. Rdn. 1966 & 1967 

Constant Term 



• 02381 
.58052 

— .15797 
.44648 :: 

—6.93003 

— .65395 i 
.09708 



Total (Expected Score) 

Expected Score 
+ Standard Error 



Upper Confidence Limit 



Expected Score 
- Standard Error 



Lower Confidence Limit 



Actual Score (School dis- 
trict average sixth grade 
arithmetic score for 1969) 
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EQUATION WORKSHEET 8 
SIXTH GRADE ARITHMETIC 1970 



Var. 
No, 


Variable 
Symbol 


X2 


FTV68 




3A67 


^15 


3Rsd67 




3Asd67 


X3 


PR70Ppl 


H 


D68 




1R67,68 


a 





Variable Name 
Full Tax Value 1968 
Third Grade Arith. 1967 

Third Grade Reading Stand. 

Dev- 1967 
Third Grade Arith. Stand. 

Dev. 1967 

Proportion N + SS Pupils 

1970 
Density 1968 

Aver. Rdn. 1967 & 1968 

Constant Term 



Coefficient 

01680 t 
,61210 

• 15221 

• 21568 

-7-35324 
1.21735 

•10688 



Value of 
Variable 



Total (Expected Score) 

Expected Score 
-f Standard Error 



Upper Confidence Limit 



Expected Score 
- Standard Error 



Lower Confidence Limit 



Weighted 
Value 



Actual Score (School dis- 
trict average sixth grade 
arithmetic score for 1970) 



.84 



2^56 



2^56 
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APPENDIX D: PROFILES OF SCHOOL DISTRICT CHARACTERISTICS 
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